Bayesian Variable Selection in Qualitative
نویسندگان
چکیده
The Bayesian variable selection method proposed in the paper is based on the evaluation of the Kullback-Leibler distance between the full (or encompassing) model and the submodels. The implementation of the method does not require a separate prior modeling on the submodels since the corresponding parameters for the submodels are deened as the Kullback-Leibler projections of the full model parameters. The result of the selection procedure is the submodel with the smallest number of covariates which is at an acceptable distance of the full model. We introduce the notion of explanatory power of a model and scale the maximal acceptable distance in terms of the explanatory power of the full model. Moreover, an additivity property between embedded submodels shows that our selection procedure is equivalent to select the submodel with the smallest number of covariates which has a suucient explanatory power. We illustrate the performances of this method on a breast cancer dataset, where they appear to be quadratic (as opposed to exponential) in the number of covariates.
منابع مشابه
A New Hybrid Framework for Filter based Feature Selection using Information Gain and Symmetric Uncertainty (TECHNICAL NOTE)
Feature selection is a pre-processing technique used for eliminating the irrelevant and redundant features which results in enhancing the performance of the classifiers. When a dataset contains more irrelevant and redundant features, it fails to increase the accuracy and also reduces the performance of the classifiers. To avoid them, this paper presents a new hybrid feature selection method usi...
متن کاملThe Impact of Different Genetic Architectures on Accuracy of Genomic Selection Using Three Bayesian Methods
Genome-wide evaluation uses the associations of a large number of single nucleotide polymorphism (SNP) markers across the whole genome and then combines the statistical methods with genomic data to predict the genetic values. Genomic predictions relieson linkage disequilibrium (LD) between genetic markers and quantitative trait loci (QTL) in a population. Methods that use all markers simultaneo...
متن کاملBayesian Variable Selections for Probit Models with Componentwise Gibbs Samplers
For variable selection to binary response regression, stochastic search variable selection and Bayesian Lasso have recently been popular. However, these two variable selection methods suffer from heavy computation burden caused by hyperparameter tuning and by matrix inversions, especially when the number of covariates is large. Therefore, this article incorporates the componenetwise Gibbs sampl...
متن کاملBayes and Empirical-bayes Multiplicity Adjustment in the Variable-selection Problem
This paper studies the multiplicity-correction effect of standard Bayesian variable-selection priors in linear regression. The first goal of the paper is to clarify when, and how, multiplicity correction is automatic in Bayesian analysis, and contrast this multiplicity correction with the Bayesian Ockham’s-razor effect. Secondly, we contrast empirical-Bayes and fully Bayesian approaches to vari...
متن کاملBayesian forecasting with highly correlated predictors
This paper considers Bayesian variable selection in regressions with a large number of possibly highly correlated macroeconomic predictors. I show that by acknowledging the correlation structure in the predictors can improve forecasts over existing popular Bayesian variable selection algorithms.
متن کامل